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I.  INTRODUCTION 


This  paper  Is  devoted  to  deterministic  inventory  models  for  three 
primary  reasons.  The  first  is  that  such  models  provide  considerable  insight 
about  inventory  models  which  nay  not  be  deterministic.  The  second  is  that 
many  stochastic  models  are  approximated  by  deterministic  ones  (for  example, 
by  using  expected  demand  rates  in  place  of  deterministic  ones).  The  third  is 
the  limited  variety  of  deterministic  models  which  have  been  studied  in  the 
literature.  The  first  two  reasons  arc  of  particular  importance  to  people 
who  are  applying  inventory  theory  to  real-world  inventory  systems. 

Past  work  [3]  on  deterministic  inventory  models,  with  few  exceptions, 
has  assumed  the  nature  of  the  ordering  policy  to  vithh  one  or  two  unknown 
parameters.  For  example,  a  periodic  review  model  might  specify  that  a 
quantity  Q  can  only  be  ordered  at  the  end  of  a  known  period  of  time  T- 
The  unusual  problem  would  be  to  determine  the  value  of  the  parameter  Q  which 
minimizes  the  total  purchase  or  production  plus  holding  costs.  If,  however, 
the  nature  of  the  optimal  policy  need  not  be  specified  prior  to  the  analysis 
then  we  would  expect  that  the  complete  nature  of  the  optimal  policy  will  result. 

Unfortunately,  if  the  nature  of  the  ordering  policy  is  not  specified 
then  considerable  complexity  of  analysis  can  result  if  one  attempts  to  use  the 
differential  calculus  (see,  for  example,  the  work  of  Arrow  and  Karlin  '[2D- 
This  complexity  can  be  reduced  however  if  the  Maximum  Principle  of  Pontryagin 
et  al  [4]  is  used  in  determining  the  optimal  ordering  policy.  Such  an  approach 
will  be  taken  in  this  paper. 

The  paper  begins  with  an  analysis  of  the  no-stockout  periodic  review 
problem  posed  by  Arrow  and  Karlin  [2]  to  illustrate  the  approach  and  the 


simplicity  of  analysis  chat  it  provides.  Then  an  analysis  of  n  periodic  review 
problem  with  stockouts  allowed  is  nadc  to  show  how  the  allowing  of  stockouts 
complicates  the  optimal  control  problem. 


II.  NO-STOCKOUTS  PROBLEM 


and  consider  it  to  represent  a  constraint  on  u(t). 

The  production  and  holding  costs  per  unit  time  will  be  represented  by 
c(u(t))  and  h(I(t))  respectively.  We  will  assume  that  they  are  monotone- 
increasing  and  continuously  differentiable  in  their  respective  arguments.  No 
other  costs  are  assumed  to  exist.  The  total  production  plus  holding  costs 
for  the  period  are  given  by  (3) . 

fT 

J(u)  -  [c(u(t))  +  h(I(t))]dt  .  (3) 
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Our  objective  Is  to  find  a  policy  u(t)  *  0  which  aati.fi**  (2) 
and  minimizes  (3). 

Ttu.  Haxinua  Premie  for  the  Problem-For  convenience,  we  will  refer  to  (3) 
in  the  following  form  in  our  analysis: 


J(u)  - 


T 


0 


f0(u,I)dt  . 


In  applying  the  Maximum  Principle  a  function  called  the  Hamiltonian 
is  created  as  follows: 


dl 


hCu.i.Pq.p^O  -  P0(c)f0(u,D  +  px(t) 


(A) 


The  derivative  £  is  obtained  by  differentiating  (1) .  The  Hamiltonian,  upon 
introducing  the  expressions  for  f„  and  £  ,  la  gl»an  by  (5)  where  t  has 
been  suppressed. 


H(u,ItP0*Pj)  -  P0lc(u)+h(I)l  +  Pjlu-r] 

For  fixed  I.  and  let  Md.p^)  -  -*  ■(«. I .P0.»l>  OVCr  tte  d0Ml” 

of  u(t)  values  satisfying  u(t)  5:  0  and  l(t)  *  0  . 

The  necessary  conditions  for  optimality  of  our  problem  from  the 

Maximum  Principle  are  given  bj  the  following  theorem  [A]. 

Theorem :  An  admlaslble  order  policy  u*(t)  and  the  reaultlng  Inventory  level 
l*(t)  are  optimal  If  there  exlBt  continuous  functions  pQ(t)  and  Pj^ft) 

which  satisfy 


dl  _  3H_ 

dt  "  3p1 


dt 


0 


(6) 

(7) 
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dpl .  dll- 

dt  "  dl  ; 

(8) 

P0(T)  -  -  1  ; 

(9) 

PX(T)  -  0  { 

(10) 

such  chat 


H(u*,I*,Pq.P1)  "  MCI^.Pq.Pj^) 

for  all  c  in  (0,T). 

The  condition  given  by  (10)  is  a  consequence  of  the  transveraality 
condition  for  a  free  right-hand  end  condition  for  I(t)  ;  that  is,  we  are  not 
going  to  force  I(T)  to  take  on  any  specified  value.  This  is  a  point  of  major 
difference  between  this  analysis  and  that  of  Arrow  and  Karlin[2]  and  Adiri  and 
Ben-Israel  (1).  In  both  of  these  studies  the  assumption  was  made  that  I*(T)  ■  0. 
If,  however,  I(T)  ■  0  is  really  optimal  then  the  results  of  the  analysis  should 
show  it.  We  shall  see  below  that  they  do. 


The  Optimal  Policy — Examining  the  conditions  from  the  theorem  we  get  back  from 
(6)  our  constraint  that  ■  u(t)  -  r(t)  and  consequently  that 

ft 


I(t)  -  1(0)  + 


[u(x)-r(T)]dT 


) 

0 


with  1(0)  as  the  given  initial  condition.  From  (7)  and  (9)  we  get  Pg(t)  “  -1 
for  all  t  in  [0,Tj.  From  (8)  we  get 


and,  because  Pq(0  ■  -1» 


d  h(I) 
dl 


dpl  „  d  h(l) 
dt  dt 
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!>**** 


Solving  for  p^(t), 


ft 


Pl(t) 


MP-  dT  +  pi(0> 


(ID 


Because  of  (10)  p^(T)  =0  is  needed  and  it  follows  that 


Pl(0)  =  - 


and, therefore ,  (11)  reduces  to 


d  h(I) 
dl 


dx 


P1(t)  =  “ 


d  h (I) 
dl 


dt 


(12) 


We  will  find  ^  helpful  in  selecting  u*(t) 


From  (5)  we  obtain 


dH 


d  c  (u) 


du  P0  du 


+  Pi 


(13) 


Substitution  of  Pg(t)  =  “3  and  p^(t)  as  given  by  (12)  into  (13)  then  results 
in 


dH 

du 


d  c  (u) 
du 


d  h(I) 
dl 


dx 


(14) 


Because  we  assumed  ^  >  0  and  — >0  it  is  immediately  evident  from  (14) 

that  ^  <  0  for  t  in  [0,T]  and  therefore  that  the  maximum  value  of  H 

occurs  for  the  smallest  value  of  u(t)  which  satisfies  u(t)  £:  0  and  I(t)  S:  0 
Therefore,  we  deduce  that 


u*(t)  = 


0  for  0  £  t  <  t^  ; 
r  (t)  for  t^  ts  T  , 


(15) 


where  t^  is  obtained  (1)  when  I(t^)  =  0;  that  is,  from 


0 


r(x)dx  =  1(0) 
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In  other  words,  the  optimal  order  policy  is  to  first  use  up  the  on-hand  inventory, 
then  order  to  just  meet  current  demand.  We  see  that  no  inventory  is  held  after 
the  initial  inventory  1(0)  is  consumed.  It  is  therefore  immediately  evident 
that  I(T)  s  0  under  this  policy. 


Comments — The  optimal  policy  is  intuitively  appealing.  When  there  are  costs  assoc¬ 
iated  with  both  production  and  holding  inventory  we  would  like  to  avoid  incurring 
either  if  we  can.  The  constraints  require,  however,  that  we  meet  demand  when  it 
occurs.  Waiting  to  produce  until  we  have  used  up  the  existing  inventory  1(0) 
keeps  inventory  holding  costs  to  a  minimum  because  we  reduce  the  inventory  as 
fast  as  possible  while  incurring  no  production  costs.  Producing  only  to  meet 
demand  after  the  inventory  1(0)  is  used  up  insures  that  I(t)  is  zero  and 
therefore  that  no  holding  costs  are  incurred.  The  production  costs  incurred  are 
only  those  necessary  to  meet  the  demand.  The  only  restrictions  we  placed  on 
c(u)  and  h(I)  were  that 

-  >0  for  u  :>  0  , 
du 

^rr^-  >o  for  uo  . 

a  I 

We  could  also  allow  ■  £  0  and  get  the  same  result.  For  example,  if  there 


•'  * { T 


III.  STOCKOUTS-ALLOWED  PROBLEM 


Model  Formulation  —  The  problem  when  stockouts  are  allowed  in  general  form 


is  to  find  u(t)  ^  0  which  minimizes  (3);  ie, 

T 


J(u) 


[ c (u  (t ) )  +  h (I (t ) ) ]  dt  , 


where  now  h(I)  represents  holding  and  shortage  costs. 


dH 


The  Hamiltonian  and  —  in  this  case  are  the  same  as  (5)  and  (14) 


respectively.  They  are  repeated  here  for  convenience. 


H(u>i>P0»  P^)  =  Pq  [c(u)  +  h(I) ]  +  p^  [u-r] 


dh  dc  (u) 
du  du  ; 


dh(I) 


dl 


dt 


The  theorem  stated  in  the  previous  section  still  provides  the  necessary  condit¬ 


ions  for  optimal  u(t).  Although  the  assumption  that  >  0  for  u  is  0 


dh 


remains  reasonable,  the  assumption  0  is  no  longer  reasonable  over  all 

possible  I(t)  values  because  the  "stockouts-allowed"  case  can  result  in 


dh 


I(t)  <0.  We  expect  instead  that  ~  £  0  for  I(t)  <  0  because  a  reduct¬ 


ion  in  the  number  of  shortages  should  result  in  a  decrease  in  stockout  costs. 
It  is  therefore  possible  to  get 

rT 


dh(I) 


dl 


dr  <  0 


and  if  this  integral  is  large  enough  it  could  cause 


dH 


du 


£  0 
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t  .mi _ !jm 


,  - - - - 


for  some  values  of  t  in  [ 0 , T ] .  If  this  should  happen  then  optimal  u 
would  be  infinite  unless  we  impose  an  upper  bound  on  its  range.  We  will 
therefore  assume  u(t)  £  b  <  ®  . 


It  is  important  to  observe  that  we  will  always  have 


M  „  _  -dc.(u)  >  o 
du  t=T  du 


We  can  therefore  say  that  regardless  of  the  form  of  h(I)  the  optimal 


ordering  policy  will  always  have  u  (T)  =  0.  This  information  will  be  ex¬ 


tremely  useful  in  the  analysis  of  the  problem  allowing  stockouts. 


To  progress  beyond  this  observation,  we  must  select  a  form  for  h(I) 


Suppose  we  assume  a  linear  form  as  follows: 


-h, I(t)  for  I(t)  £  0 


h(I(t) ) 


h^lCt)  for  I(t)  ^  0 


where  h^  >  0  and  h^  >  0  represent  the  shortage  and  holding  costs  per 


unit  of  inventory  per  unit  time.  When  we  attempt  to  obtain  the  derivative 


this  form  we  realize  that  it  does  not  exist  at  I(t)  =  0.  If,  instead. 


we  assume  that  h(I(t))  smoothly  transitions  from  -h^lCt)  at  I(t)  =  -e 


to  +1^1(0  at  I(t)  =  +  e  for  e  >  0  but  very  small  then  the  derivative 


will  exist  at  any  point  in  the  e -neighborhood  of  I(t)  =  0.  If  we  assume 


further  that  the  minimum  point  of  the  h(I)  curve  occurs  at  1=0  we  can 


approximate  by  the  following  form: 


-h  for  I(t)  <  0 


Yy  =  <  0  for  I(t)  -  0 


for  I(t)  >  0 


For  convenience  we  will  also  assume 


dc 

du 


k  and  r(t)  =  r  where  k 


and  r  are  positive  constants. 

Preliminary  Observations  about  the  Optimal  Policies — Under  the  model  assumpt¬ 
ions  we  see  that  if  I (t )  >  0  over  [ 0 , T]  then 

h2dx  =  -k  -h2[T-t]  (16) 

and  we  realize  that  —  <  0  for  all  t  in  [0,T] .  The  optimal  order  policy 
* 

is  u  (t)  =  0.  Now  if  1(0)  i  rT,  we  will  get  I(t)  =  l(0)-rt  >  0  for 
u(t)  =  0  except  possibly  at  T  where  I(T)  =  0  when  1(0)  -  rT. 

Suppose  next  that  1(0)  <  0  and  we  order  nothing,  then  I(t)  ■  1(0)  -rt  <  Q> 
for  all  t  in  [0,T].  In  this  case. 


£  -  -k  +  hx  [T-t]  ,  (17) 

and  it  is  possible  to  get  ^  i  0.  If  we  set  “  0  and  solve  for  t  in 

du  du 

(17)  we  get 

t  -  T  -  £  .  (18) 

In  the  range  t  <  t  we  have  ~  >  0;  in  the  range  t  <  t  S  T  we  have 


dH 

du 


<  0. 


Because  T,k,  and  are  parameters  of  the  problem  it  is  possible  to 

have  t  <  0  so  that  <  0  over  all  t  in  (0,T).  This  will  occur  when 
k 

T  <  r-  .  The  optimal  policy  when  this  happens  is  to  order  nothing;  ie, 
nl 


u  (t)  ■  0. 

When  T  >  then  ~  >  0  if  we  order  nothing.  However,  ~  >  0 

implies  that  u*(t)  «  b.  If  b  >  r  then  it  is  possible  to  get  l(t)  >  0 


towards  the  end  of  the  time  period  and  (17)  would  no  longer  apply.  Some 
form  such  as  (19)  is  suggested  for  t  in  [0,t^]  where  t^  is  the  value  of 
t  when  I  ( t )  =  0. 


£  -  -  k  +  h1[t1  -  t]  -  h2[T-t1]  .  (19) 

In  spite  of  the  additional  complex  forms  for  —  which  may  arise,  they  will 
all  have  an  appearance  uimilar  to  (19) . 


The  Optimal  Policies — The  optimal  policies  for  the  stockouts-allowed  problem 
will  be  stated  before  the  arguments  leading  to  these  policies  are  presented. 
Before  stating  the  optimal  policies  it  is  convenient  to  define  several 
quantities. 

Let 


h. [r-b]t 

T  m  — — 

1  hx+h2 


(20) 


I2  "  (r-b]t 


(21) 


!3  -  rt  , 


(22) 


t  - 


Ihj+h^KO)  -  hL[r-bJt 


h^b+h^r 


where  c,  given  by  (18),  is  repeated  here  for  convenience. 


(23) 


t  -  T  -*  £ 
h. 
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The  optimal  order  policies  are: 


1.  If  t  >  0 
1(0)  £  i2, 


2.  If  t  >  0, 


3.  If  t  >  0, 


4.  If  c>  0 


5.  Otherwise 


and  (a) 

0 

<  b 

<  r,  1(0)  £  Ix,  or 

then 

*  1 

i 

b 

for 

0  s  t  s  t  , 

u  (t)  =  { 

* 

1 

0 

for 

t  <  t  S  T  . 

0  <  b  <  r, 

and 

l1  <  1(0)  <  I3,  then 

f 

0 

for 

0s  t  <  t  , 

* 

u  (t)  “  < 

b 

for 

t  *  t  £  t  , 

0 

i 

for 

t  <  t  £  T  . 

b  i  r, 

and 

0  £ 

1(0)  £  I3,  then 

r  0 

for 

0d.<M 

r 

c 

» 

rr 

a 

r 

for 

£  t  £  t 
r 

.  o 

for 

t  <  t  s  T  . 

,  bi  r, 

and  12 

<  1(0)  £  0,  then 

/ 

b 

for 

0  =  ..flffl}. 

(b-rj 

u  (t)  »  < 

r 

for 

dLio>  <  c  -  ; 

lb-r)  E  -  C 

0 

for 

t  <  t  £  T  . 

\ 

u*(t)  *  0  for  nil  t  in  (0*T) 
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Proof  of  the  Optimal  Policies — We  have  already  shown  that  u  (t)  =  0  if 

If 

1(0)  £  rT  or  if  I(t)  <  0  and  t  <  0  (that  is,  T  <  -r  )  in  our  pre- 

1 

liminary  comments.  These  cases  corresponded  to  ~  <0  over  all  t  in 


[0,T].  We  can  add  I(t)  <0  and 

t  =  0 

to  this  list 

immediately  because 

A  dH 

t  ■  0  corresponds  to  =  0  at 

t  =  0 

.  dH 

and  thus  -r~ 
du 

<  0  for  all  t 

(0,TJ. 

Turning  next  to  the  case  of  I(t)  £  0  and  t  >  0  we  realize  that, 
because  (17)  applies,  ^  >  0  for  t  in  [0,t).  In  this  time  period 
u*(t)  »  b  is  the  policy  which  will  maximize  H(u).  The  period  (t,T)  has 

Jm  ^  ^  j|j| 

—  <  0  in  (17)  and  u  (t)  n  0,  The  switch  from  u  (t)  »  b  to  u  (t)  «  0 

du 

a 

takes  place  at  t. 

The  conditions  necessary  for  maintaining  I(t)  £  0  can  be  obtained 
from  consideration  of  the  following  equation  for  I(t)  which  results 
from  the  optimal  policy  just  stated. 


fl(0)  +  [b-r]t  for  0  £  t  £  t  , 


I(t)  »  ( 

1(0)  +  bt  -  rt  for  t  <  t  £  T 

If  b  <  r  chen  I(t)  decreasts  as  t  increases  over  (0,T).  Therefore, 
if  1(0)  £  0  then  I(t)  £  0  over  (0,T).  If  b  ■  r  then  I(t)  ■  1(0)  as 

long  ns  u(t)  "  b  and  decreases  as  soon  os  u(t)  ■  0. 

If  b  >  r  it  is  possible  to  have  I(t)  >  0.  Now  if  b  >  r  the  max¬ 

imum  value  of  I(t)  occurs  at  t.  if  I(t)  is  to  be  nonpositive  chen 
we  must  hove 
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I  ( t )  £  0  will  occur  if 


1(0)  £  [r-b] t  =  I2 
where  <  0  because  b  >  r. 

In  summary,  we  have  just  shown  that 


^  I  b  for  0  £  t  £  t  , 

u  (t)  *»  / 

|  0  for  t  <  t  S  T  , 

for  all  the  conditions  except  0  <  1(0)  £  1^  for  0  <  b  <  r  of  the  first 
optimal  policy. 

dH 

For  1(0)  >0  it  is  also  possible  to  ~  >  0  for  some  portion  of  (0,T) . 
We  will  concentrate  on  the  range  0  <  1(0)  <  rT  because  we  have  already 

shown  that  u  (t)  *  0  for  1(0)  i  rT.  If  u(t)  ■  0  and  1(0)  is  in  this 

range  then  I(t)  <  0  for  t^ <  t  &  T  where 


t 


1 


(24) 


The  corresponding  expression  for 


dH 

du 


is 


dH 

du 


-k  -l^lt^-t]  +  h^ [T— t ^ ]  for  0  s  t  s 
-k  +h1(T-t)  for  t1  S  t  S  T 


(25) 


^  has  a  slope  of  (+h2)  in  the  region  0  £  t  £  and  a  slope  of  (-h^) 

dH 

in  the  region  t^  £  t  £  T.  A  representative  family  of  curves  for  (25) 


4 


are  shown  in  figure  1  and  covers  1(0)  values  for  [0,rT].  The  curves 
designated  by  1  and  5  correspond  to  1(0)  ■  0  and  1(0)  ■  rT,  respect¬ 
ively.  The  optimality  condition  ^  ■  -k  for  t  *  T  is  imposed  on  each 


curve  of  the  figure. 

Any  curve  between  1  and  2  suggests  one  switching;  that  is, 


dH 

du 


is  positive  for  t  <  t  and  negative  for  t  >  t.  Any  curve,  such  as  3  , 

between  2  and  4  suggests  two  switchings  because  ^  is  negative,  then 

positive,  and  then  negative  again.  Any  curve  between  4  and  5  suggests 
no  switching  should  take  place. 

It  is  immediately  evident  that  conditions  resulting  in  — •  curves 
between  4  and  5  can  be  added  to  the  u  (t)  ■  0  list.  Curve  4  corres¬ 
ponds  to  t^  *  t  which,  when  stated  in  terms  of  1(0),  results  in 

1(0)  -  rt=  I3 

Therefore,  if  1(0)  i  I3  then  u  (t)  *»  0  for  all  t  in  (0,T). 

Because  u(t)  »  0  is  not  optimal  for  the  curves  between  1  and  4 
we  will  first  investigate  the  behavior  of  I(t)  when  we  follow  the  switch¬ 
ing  patterns  suggested  by  the  curves.  We  will  then  re-evaluate  the  express¬ 
ions  for  ~  .  This  process  may  require  several  iterations  before  a  pair 

dH 

of  "matching"  I(t)  and  ^  curves  can  be  obtained  signalling  that 
optimal  u(t)  has  been  found. 

One  switching  should  be  considered  for  conditions  creating  the  curves 

dH 

between  1  and  2  ;  the  switching  should  occur  at  ^  »  0.  From  figure  1 


we  know  that  ^  ■  0  only  in  the  segment  dominated  by  h^  and  that  (17) 

a 

applies.  Therefore  switching  should  occur  at  t. 
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A 


If  we  let 


then,  from  (1) , 


u(t)  - 


b  for  0  £  t  £  t  , 


0  for  t  <  t  &  T  , 


1(0)  +  (b-r ] t  for  0  £  t  £  t  , 


1(0)  +  bt  -  rt  for  t  <  t  £  T 


A  family  of  I(t)  curves  for  (26)  is  shown  in  figure  2.  Curve  1  is 
representative  of  a  case  when  b  >  r.  Curve  2  results  from  b  ™  r.  Curves 
3,4,  and  5  correspond  to  b  <  r.  Curve  5  has  b  =■  0  and  is 
the  limiting  curve  for  the  b  <  r  cases. 

Figure  3  shows  the  curves  of  ^  corresponding  to  I(t)  curves  of 
figure  2.  The  same  curve  numbers  have  been  used  in  both  figures  to  show 
the  correspondence.  Curves  between  1  and  3  have  4^  <  0  over  [0,T] 


and  suggest  that  no  switching  is  optimal.  Curves  between  3  and  5  suggest 


that  at  least  one  switching  is  optimal. 

For  any  curves  between  4  and  5  we  see  that 


has  the  same 


behavior  as  in  figure  1  for  curves  between  1  and  2  .  Therefore, 


* 

u  (t) 


b  for  0  £  t  £  t  , 


0  for  t  <  t  i  T  , 


for  the  conditions  leading  to  these  ^  curves. 

dH  - 

The  first  condition  is  that  0  <b  <  r.  The  second  is  that  ^  i  0 
at  t  -  0.  Translating  this  into  a  relationship  involving  1(0)  we  have 


««  s  lhiT-ki  5  *i  • 


This  analysis  has  been  based  on  the  assumption  that  1(0)  >  0,  therefore 
the  proof  of  the  first  optimal  policy  is  complete. 

We  consider  next  the  curves  between  3  and  4  .  Figure  2  indicates 

that  0  <b  <  r  and  figure  3  shows  that  two  switchings  may  be  optimal; 

A  A  A 

A 

the  first  at  some  time  t  prior  to  t  and  the  second  at  t.  The  following 
policy  is  therefore  suggested. 


u(t)  =  /  b 
0 

The  corresponding  expression  for  I(t) 


for  0  £  t  <  t  , 
for  t  £  t  £  t  , 
for  t  <  t  £  T 
would  then  be 


(27) 


'  1(0) 

-  rt 

for 

0  £  t  <  1: 

I(t)  =  ( 

1(0) 

+  b[t-tl  -  rt 

for 

A 

t  £  t  si  f. 

1(0) 

A  A 

+  b [ t-t ]  -  rt 

for 

t  <  t  £  T 

(28) 


V 

Figure  4  illustrates  the  family  of  curves  associated  with  (28)  and 

dH 

figure  5  presents  the  corresponding  curves.  From  these  two  figures  we 

* 

see  that  curves  2  and  3  will  have  u  (t)  given  by  (27).  To  find  the 
"  dH 

value  of  t  we  set  —  =  0  in  equation  (19)  where  now  I(t)  =  0  at 


t 


1 


t  + 


1(0)  -  rt 
b  -  r 


We  will  get  the  expression  given  by  (23)  and  t  >  0  if 


h  [r-b] t 

1<0)  -  -tnr.  h 


1  2 


Similarly,  t  <  t  if 


1(0)  <  rt  =  I3  . 


When  i(0)  ■  I.  we  get  t  »  0  and  the  optimal  policy  given  by 


-19- 


— . .  - ,,,....,,..^l...^^,-,i..,:-.„-^^.,>^,.,^..^^^»^..J.  < 


(27)  reduces  to  that  derived  above  for  the  case  of  1(0)  £  1^  and  I(t) 
corresponds  to  curve  A  of  figure  A.  If  t  »  t  then  (27)  reduces  to 

u  (t)  ■  0  and  I(t)  corresponds  to  curve  1  of  figure  A.  We  have  already 

A 

shown  that  u  (t)  -  0  if  1(0)  £  regardless  of  the  relationship  of 
b  to  r.  In  summary,  when  t  >  0,  b  <  r,  and  1^  <  1(0)  s:  I  then 

A 

u  (t)  is  given  by  (27)  and  the  second  optimal  policy  is  confirmed. 

To  complete  the  analysis  of  cases  for  1(0)  i  0  we  next  consider  the 
case  of  b  r.  When  b  ■  r  the  bound  1^  is  zero  while  I^  does  not 

change  so  0  £  1(0)  £  I^.  Equation  (23)  reduces  to 

=  .1101. 

r 

a 

A 

We  realize  that  t  occurs  simultaneously  with  t^  as  given  by  (2A) 

i  dH 

and  hence  I(t)  -  0  between  t  and  t.  Equation  (31)  shows  that  -r— 


is  constant  over  this  interval  because  4^  =  0 

du 

for 

I(t)  =  0 

f  -k  -  h2 [ t-t]  +  h^T-t] 

for 

A 

0  s:  t  £  t 

-k  +  hjiT-ej 

for 

t  £  t  £  t 

k  -k  +  hx[T-t] 

for 

VI 

4J 

VI 

<  4-1 

From  the  definition  of  t  we  also  realize  that  this  constant  value  of  -j- 

du 

A 

must  be  zero.  Therefore  u  (t)  can  take  on  any  value  between  0  and  b. 

a  a  k 

However,  I (t )  »  0  for  t  in  [t,t]  only  if  u  (t)  -  b. 

This  argument  can  be  easily  extended  to  the  case  of  b  >  r.  The  optimal 

policy  should  take  the  following  form,  however; 

/  £ 

|  0  for  0  £  t  <  t 

Vfe  1  A  A 

u  (t)  =  /  r  for  t  £  t  £  t  (32) 

0  for  t  <  t  £  T  . 


dH 


The  corresponding  expression  for  is  again  given  by  (31)  and  since 

dH  * 

-  0  over  t  £  t  £  t  we  can  assign  any  value  of  u  as  optimal  between 
du 

A 

0  and  b.  The  only  value  of  u  which  will  maintain  I(t)  ■  0  over  [t,t] 

is  now  u(t)  ■  r.  Figure  6  illustrates  the  resulting  curves  of  I(t)  and 

dH 
du 


.  The  third  optimal  policy  has  been  proved. 


These  arguments  can  also  be  used  for  the  case  of  b  >  r  and  1^  <  1(0)  £  0. 

We  recall  that  u(t)  *  b  for  [ 0 » t )  and  zero  outerwise  would  result  in 

*  dH 

I ( t )  >  0.  Figure  7  contains  possible  I(t)  curves.  The  corresponding 

curves  are  shown  in  figure  8. 

The  curves  3  in  the  two  figures  correspond  to  the  case  of  1(0)  °  Ij 

A 

A 

and  the  first  optimal  policy  applies  (equation  (32)  would  have  t  ■  0) . 

The  curves  1  and  2  from  figure  7  do  not  allow  ~  =  -k  for  t  *  T  and 
hence  u(t)  given  by  (32)  is  not  optimal.  However,  if  we  assume  the  following 
form  for  u(t)  we  can  satisfy  this  condition. 


where  now 


u(t)  =  < 


b 

r 

0 


The 


dH 


for  0  £  t  £  t 

A  A 

for  t  £  t  £  t 

A 

for  t  £  t  £  T 

:  _  K0) 


[b-r] 


resulting  equation  for  is 


(33) 


dH 

du 


-k  +  h^t-t]  +  h1[T=t] 
-k  +  h1[T-t] 


-k  +  h-jT-t] 


for  0  £  t  £  t 
for  t  £  t  £  t 
for  t  £  t  £  T 


dH 

We  realize,  as  we  did  for  (31),  that  du  =  ®  f°r  t  £  t  £  t  and 


23- 


Figure  8.  Curves  of 


un 


associated  with  the  I(t) 


du 

curves  of  figure  7. 
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that  we  should  select  u(t)  =  r  to  maintain  I(t)  =  0  over  this  interval. 


Therefore  (33)  gives  the  optimal  policy  when  <  1(0)  ^  0.  The  curves  of 
dH 

I(t)  and  —  are  shown  in  figure  9.  The  proof  of  the  fourth  optimal  policy 
is  complete. 

Comments — When  stockouts  are  allowed  we  see  that  the  analysis  becomes  immedi¬ 
ately  more  complex  because  the  I(t)  £  0  constraint  has  been  removed  and 
therefore  the  region  of  feasible  u(t)  has  expanded  to  always  include 
u(t)  =  0.  The  assumption  of  an  upper  bound  on  u  and  specific  forms  for 
the  elements  of  the  cost  function  appear  necessary  before  an  analysis  can 
proceed. 

The  linear  problem  presented  in  the  preceding  section  was  chosen  for 
the  illustration  of  the  stockouts-allowed  analysis  primarily  because  the 
cost  functions  are  typical  of  many  deterministic  models  appearing  in  the 
literature.  Future  analyses  will  investigate  the  influence  of  several  diff¬ 
erent  nonlinear  cost  forms.  It  should  be  evident  from  the  preceding  analysis 
that  while  the  use  of  the  Maximum  Principle  allows  a  general  order  policy  to 
be  postulated,  it  requires  that  careful  consideration  be  given  to  the  form 
of  the  objective  function.  In  contrast  to  the  no-stockouts  model,  the 
nature  of  the  form  selected  will  strongly  influence  the  nature  of  the  optimal 
order  policy. 

The  iterative  procedure  of  postulating  u(t),  evaluating  I (t )  and 
,  and  re-postulating  u(t)  until  finally  a  "matched  set"  of  expressions 
for  I(t)  and  ^  is  obtained  seems  to  hold  considerable  promise  for 
problems  having  nonlinear  cost  functions.  The  virtue  in  obtaining  the  "matched 
set"  is  that  then  both  the  necessary  and  sufficient  conditions  for  optimality 
have  been  obtained. 
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The  use  of  Pontryagin's  Maximum  Principle  in  analyses  of  deterministic 
inventory  models  requires  less  restrictive  assumptions  about  the  nature  of 
order  policies  than  can  be  allowed  when  only  the  differential  calculus  is 
used.  Two  analyses  are  presented  to  illustrate  this  fact.  The  first  in¬ 
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and  holding  cost  functions  were  kept  as  general  as  possible.  The  second 
analysis  involves  a  periodic  review  model  with  shortages  allowed  and  linear 
production  and  inventory  costs.  As  would  be  expected,  the  optimal  order 
policies  obtained  are  more  general  than  those  obtained  in  the  past.1' 
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